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1. (original) A context-aware imaging device, comprising: 

an image capturing and display system that captures and displays an image 
containing a landmark of interest; 

a context interpretation engine that generates contextual information relating to 
the landmark, wherein the image capturing and display system and the context 
interpretation engine form a physically integrated unit. 

2. (original) The imaging device of claim 1, wherein context interpretation engine 
generates the contextual information by 

determining geographical information of the landmark in the captured image; 
searching a landmark database with the geographical information of the landmark 
to obtain the contextual information of the landmark. 

3. (original) The imaging device of claim 1, wherein the context interpretation engine 
further comprises 

an area determination system that determines the geographical information of the 
landmark; 

a landmark database that stores geographical information of landmarks and their 
corresponding contextual information to provide the contextual information of the 
landmark if accessed with the geographical information of the landmark. 

4. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a location sensor that provides location information of the imaging device; 
an orientation sensor that determines the direction in which the image capturing 
and display system is aiming; 
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a context interpreter that generates the geographical information of the landmark 
by defining a segmented viewing volume within which the landmark is located using the 
location, the direction, and the orientation information. 

5. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a location sensor that provides location information of the imaging device; 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming; 

a zoom sensor that determines the viewing angle of the image capturing and 
display system; 

a context interpreter that generates the geographical information of the landmark 
by defining a segmented viewing volume within which the landmark is located using the 
location, the viewing direction, and the zoom information provided by the sensors, 

6. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a location sensor that provides location information of the imaging device; 

a distance sensor that determines the distance to the landmark from the image 
capturing and display system; 

a context interpreter that generates the geographical information of the landmark 
from the location and distance information provided by the sensors, 

7. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a location sensor that provides location information of the imaging device; 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming; 

a distance sensor that determines the distance from the image capturing and 
display system to the landmark; 
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a context interpreter that generates the geographical information of the landmark 
from the location, the viewing direction, and the distance information provided by the 
sensors. 

8. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features to search the landmark database 
for any landmark image with matching image features. 

9. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a location sensor that provides location information of the imaging device; 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features and the location information to 
search the landmark database for any landmark image with matching image features and 
similar locaffon information. 

10. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming; 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features and the direction information to 
search the landmark database for any landmark image with matching image features and 
along the same direction. 
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1 1 . (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a zoom sensor that determines the viewing scope of the image capturing and 
display system; 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features and the viewing scope 
information to search the landmark database for any landmark image with matching 
image features and within the viewing scope specified by the zoom sensor. 

12. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a distance sensor that determines the distance from the image capturing and 
display system to the landmark; 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features and the distance information to 
search the landmark database for any landmark image with matching image features and 
within the distance specified by the distance sensor. 

13. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a zoom and distance sensor that determines the projection angle of the image 
capturing and display system, and the distance from the image capturing and display 
system to a geographical point at which the image capturing and display system is 
focused; 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features, the projection angle and the 
distance information to search the landmark database for any landmark image with 
matching image features and within the projection angle and distance specified by the 
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zoom and distance sensor. 

14. (original) The imaging device of claim 3, wherein the area determination system 
further comprises 

a location sensor that provides location information of the imaging device; 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming; 

a zoom and distance sensor that determines the projection angle of the image 
capturing and display system, and the distance from the image capturing and display 
system to a geographical point at which the image capturing and display system is 
focused; 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image; 

a context interpreter that uses the image features, the projection angle and the 
distance information to search the landmark database for any landmark image with 
matching image features and within the projection angle and distance specified by the 
zoom and distance sensor. 

15. (original) The imaging device of claim 3, wherein the area determination system 
further comprises a geographical information extractor coupled to the image capturing 
and display system to extract the geographical information of the landmark from the 
captured image. 

16. (original) The imaging device of claim 15, wherein the image capturing and display 
system further comprises an image sensor that captures the image with the landmark, 
wherein the image sensor also collects the geographical information of the landmark and 
attaches the geographical information to the image. 

17. (original) The imaging device of claim 1, wherein the context interpretation engine 
further comprises an updating module that can provide real time updates to the contextual 
and geographical information of each of the landmarks stored in the engine. 
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18. (original) The imaging device of claim 17, wherein the updating module further 
comprises 

a wireless communication interface that establishes wireless communication with 
external wireless network; 

an update request module that browsers external Internet via the wireless 
communication interface to obtain the real time updates. 

1 9. (original) The imaging device of claim 1 , wherein the image capturing and display 
system and the context interpretation engine reside inside a single enclosure. 

20. (original) The imaging device of claim 1 , wherein the image capturing and display 
system and the context interpretation engine reside in different enclosures, but still 
physically attached to each other to form the physically integrated unit. 

21 . (original) The imaging device of claim 1, wherein modules of the context 
interpretation engine reside in different enclosures, and have intermittent connectivity 
with each other. 

22. (original) The imaging device of claim 1 , further comprising a context rendering 
module coupled to the context interpretation engine to render the contextual information 
relating to the landmark to the user of the imaging device. 

23. (original) The imaging device of claim 22, wherein the context rendering module is a 
display that can be either separated from or overlaid with a display of the image capturing 
and display system. 

24. (original) The imaging device of claim 22, wherein the context rendering module is 
an audio player. 

25. (original) The imaging device of claim 1, wherein the image capturing and display 

7 



PACE 9/16 " RCVD AT 7/3/2006 12:01:43 PM [Eastern Daylight Time] * SVR:USPTO-EFXRF-5/3 * DNIS:2738300 " CSID:936 372 3075 * DURATION (mm-ss): 05-26 



Jul 03 0G 11:04a Calvin Mckerley 



936-372-3075 



p. 10 



Serial No.: 09/989,181 
Response to OA of 04/06/2006 

system can be selected from a group comprising a binoculars system, a telescope system, 
an eyeglass system, a camera system, a digital camera system, and a video camera 
system. 

26. (original) The imaging device of claim 1, wherein the context interpretation engine 
further comprises 

a user interface that allows user inputs to the context interpretation engine; 
a storage that stores user inputs from the user interface, wherein the storage also 
stores the captured image of the landmark and its contextual information. 

27. (previously presented) The imaging device of claim 1, wherein the image capturing 
and display system includes a digital camera. 

28. (previously presented) An image device, comprising: 

an image sensor for capturing an image of a landmark being viewed by a viewer 
through the image device; 

an engine for recognizing the captured image of the landmark and for retrieving 
information that describes the recognized landmark; and 

a display for displaying the retrieved information and the captured image of the 
recognized landmark. 

29. (previously presented) The image device of claim 28 wherein the image device is a 
digital camera. 

30. (previously presented) The image device of claim 28 wherein the image device is a 
cellular phone. 

31 . (previously presented) The image device of claim 28 wherein the image device is a 
one of binoculars or a telescope device. 
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32. (previously presented) The image device of claim 28 wherein the image device is a 
personal digital assistant (PDA). 

33. (previously presented) The image device of claim 28 wherein the retrieved 
information includes a name of the recognized landmark. 

34. (previously presented) The image device of claim 28 further comprising a distance 
sensor for determining a distance to the landmark focused by the image sensor. 

35. (previously presented) A method for software execution, comprising: 

capturing a digital image of a landmark being viewed through a viewer of an 

imaging device; 

identifying, with the imaging device, the landmark; and 

displaying, on the imaging device, information that describes the identified 

landmark. 

36. (previously presented) The method of claim 35 further comprising displaying, on the 
imaging device, the digital image of the landmark with the information that describes the 
identified landmark. 

37. (previously presented) The method of claim 35 further comprising focusing on the 
landmark to determine a distance from the imaging device to the landmark. 

38. (previously presented) The method of claim 35 further comprising: 

attaching geographical information and contextual information into the captured 
digital image; and 

displaying, on the imaging device, the geographical information and the 
contextual information with the captured digital image. 

39. (previously presented) The method of claim 35 further comprising: 

updating, in real time via wireless communication, the information; 
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displaying, on the imaging device, the updated information. 

40. (previously presented) The method of claim 35 further comprising: 

generating a viewing volume along a viewing direction of the imaging device; 
searching for all landmarks located inside the viewing volume; 
selecting a largest and closest landmark in the viewing volume. 

41 . (previously presented) The method of claim 35 further comprising: 

generating a viewing volume along a viewing direction of the imaging device; 
searching for all landmarks located outside the viewing volume; 
selecting at least one landmark outside the viewing volume; 
displaying, on the imaging device, information that describes the at least one 
selected landmark. 

42. (previously presented) An image device, comprising: 

means for viewing, by a viewer* an unidentified landmark; 
means for capturing a digital image of the unidentified landmark; 
means for identifying the landmark and retrieving information that describes the 
identified landmark; and 

means for presenting the information to the viewer, 

43. (previously presented) The image device of claim 42 further comprising means for 
displaying the digital image to the viewer. 
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